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Publication Title: 

Method and system for accessing associated data sets in a multimedia 
environment in a data processing system. 



Abstract: 

A method and system in a data processing system for selectively associating 
stored data with an animated element within a multimedia presentation in a data 
processing system. At least one data set is created or identified within the data 
processing system. The data set is then associated within the data processing 
system with a selected animated element within the multimedia presentation. 
Thereafter, during the multimedia presentation, the existence of the data set and 
the association between the data set and the selected animated element is 
graphically indicated utilizing a rectangle surrounding the animated element, a 
blinking figure near the animated element or any other suitable graphic indicator. 
A user may elect to have the associated data set presented by selecting the 
additional graphic element associated with the specified animated element, or by 
selecting a button or other graphic indicator, during a specified period of time 
following the graphic indication. 
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Description 

BACKGROUND OF THE INVENTION 

1. Technical Field: s 

[0001] The present invention relates in general to 
an improved data processing system, and in particular 
to a method and system for associating data sets with a 
multimedia presentation operating within a data w 
processing system. Still more particularly, the present 
invention relates to a method and system for associat- 
ing stored data sets with an animated element depicted 
in a multimedia presentation and for notifying a user of 
the existence of an associated data set during a rele- is 
vant portion of the multimedia presentation. 

2. Description of the Related Art: 

[0002] Computer systems are capable of communi- 20 
eating information with humans in many formats, includ- 
ing: text, graphics, sounds (including high-fidelity 
stereo), animated graphics, synthesized speech, and 
video. A multimedia presentation utilizes a data 
processing system to combine such information formats 25 
into often coherent and comprehensive presentation. 
[0003] In known data processing systems, an addi- 
tional data set may be linked to textual information. For 
example, utilizing hypertext, the existence of an addi- 
tional data set associated with a selected portion of text 30 
may be indicated in several ways, such as highlighting 
or underlining the selected text. The information associ- 
ated with such selected text may also be accessed in 
several ways, for example, by utilizing a pointing device, 
such as a mouse, and clicking the mouse while the indi- 35 
cator is positioned on the highlighted text. After select- 
ing highlighted text, the user may be presented with a 
list of additional relevant textual data sets. After choos- 
ing from such a list, additional textual information may 
be displayed in a new window. 40 
[0004] For example, if the word elephant appears in 
an encyclopedic article about India (note text is under- 
lined or differentiated in some manner from the sur- 
rounding text), a user may elect to access an article 
about elephants by positioning a graphical indicator, 45 
such as a mouse pointer, over the word, and clicking the 
mouse button. This selection process may then open 
another window within the display containing textual 
information about elephants. 

[0005] In prior art systems, textual information hav- so 
ing such a link to other data sets is static in nature. That 
is, the link with a particular passage of text always 
exists. While hypertext works well for textual informa- 
tion, in a multimedia environment it would be beneficial 
to link a multimedia presentation to another relevant ss 
data set and to allow such a link to be accessed only 
during a relevant period of time. That is. the link with an 
associated data set may only be active during a relevant 



portion of the multimedia presentation. 
[0006] In view of the above, it should be appreci- 
ated that a need exists for a method and system for 
graphically indicating, during a relevant period of a mul- 
timedia presentation, the existence of a data set, stored 
in a data processing system, which is associated with 
an animated element within a multimedia presentation, 
wherein a system user may elect to view or listen to the 
associated data set by selecting one or more of the 
available data sets. 

[0007] The article entitled ( (Interactive Multimedia 
Meets the Real World)) by T McMillan, Computer 
Graphics World, Vol. 12, n° 8. August 1989, pp. 39-46 
describes applications of the interactive multimedia 
concept, which allows a user to explore a multimedia 
database in a non-linear fashion, according to his or her 
own interests and needs. The article does not address 
the problem of attaching a data set to a selected ani- 
mated element in a multimedia presentation. 
[0008] The article entitled < <DVI - A Digital Multime- 
dia Technology)) by G. D. Ripley, Communications of 
the Association for Computer Machinery, Vol. 32, n° 7, 
July 1989, pp. 811-822 describes the Digital Video 
Interactive technology which makes it possible for a 
user to create multimedia presentations. There is again 
no reference to the problem of attaching data sets to 
selected animated elements in an existing multimedia 
presentation. 

[0009] The article entitled < (New-Media Document 
(NewDoc) and Dynamic Navigation on the BTRON 
Specification)) by K. Kajimoto et al., Proceedings of 
34th IEEE Computer Society International Conference, 
CompCon '89, 27 Feb. - 3 March 1989, PP- 40-42 
describes a system for allowing a user to retrieve data 
from stored data sets during relevant time sequences 
as a video-data presentation is played. While this article 
refers to a dynamic, as opposed to static, use of links, it 
does not suggest to attach stored data sets to selected 
animated elements. 

SUMMARY OF THE INVENTION 

[0010] It is therefore one object of the present 
invention as defined in the appended claims to provide 
an improved data processing system for multimedia 
presentations. 

[001 1 ] It is another object of the present invention to 
provide a method and system for associating data sets 
with a multimedia presentation operating within a data 
processing system. 

[001 2] It is yet another object of the present inven- 
tion to provide a method and system for associating 
stored data sets with an animated element depicted in a 
multimedia presentation and notifying a user of the 
existence of an associated data set during a relevant 
portion of the multimedia presentation. 
[0013] The foregoing objects are achieved as is 
now described. A method and system are disclosed in a 
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data processing system for selectively associating 
stored data with an animated element within a multime- 
dia presentation in a data processing system. At least 
one data set is created or identified within the data 
processing system. The data set is then associated 5 
within the data processing system with a selected ani- 
mated element within the multimedia presentation. 
Thereafter, during the multimedia presentation, the 
existence of the data set and the association between 
the data set and the selected animated element is w 
graphically indicated utilizing a rectangle surrounding 
the animated element, a blinking figure near the ani- 
mated element or any other suitable graphic indicator. A 
user may elect to have the associated data set pre- 
sented by selecting the additional graphic element 15 
associated with the specified animated element, or by 
selecting a button or other graphic indicator, during a 
specified period of time following the graphic indication. 
[0014] The above as well as additional objects, fea- 
tures, and advantages of the present invention will 20 
become apparent in the following detailed written 
description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 

[0015] The novel features believed characteristic of 
the invention are set forth in the appended claims. The 
invention itself however, as well as a preferred mode of 
use, further objects and advantages thereof, will best be 
understood by reference to the following detailed 30 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, wherein: 

Figure 1 depicts a pictorial illustration of a data 
processing system which may be utilized to imple- 35 
ment the method and system of the present inven- 
tion; 

Figure 2 is a high level block diagram further illus- 
trating details of the data processing system as 40 
shown in Figure 1 ; 

Figure 3 depicts a pictorial representation of a data 
processing system display at three sequential 
points in time during a multimedia presentation; 45 

Figure 4 is a high level logical flow chart which 
depicts a programmed response of the data 
processing system of Figure 1 in accordance with a 
preferred embodiment of the method and system of so 
the present invention during a set-up operation; 

Figure 5 is a high level logical flow chart which illus- 
trates a programmed response of the data process- 
ing system of Figure 1 in accordance with a 55 
preferred embodiment of the method and system of 
the present invention during a graphic indication 
process; and 



Figure 6 is a high level logical flow chart which 
depicts a programmed response of the data 
processing system of Figure 1 in accordance with a 
preferred embodiment of the method and system of 
the present invention during a user selection proc- 
ess. 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENT 

[001 6] With reference now to the figures and in par- 
ticular with reference to Figure 1 , there is depicted a pic- 
torial illustration of a data processing system 50 which 
may be utilized to implement a preferred embodiment of 
the present invention. Data processing system 50 
includes a system unit 52, a video display terminal 54, a 
keyboard 56. and a mouse 58. Data processing system 
50 may be implemented utilizing any suitable computer 
such as an IBM PS/2 computer, a product of Interna- 
tional Business Machines Corporation, located in 
Armonk, New York "PS/2" is a registered trademark of 
International Business Machines Corporation, located 
in Armonk, New York. Although the depicted embodi- 
ment involves a personal computer, a preferred embod- 
iment of the present invention may be implemented in 
other types of data processing systems, such as for 
example, intelligent work stations or mini-computers. 
[0017] Those skilled in the art will appreciate that 
the hardware depicted in Figure 1 may vary for specific 
applications. For example, other peripheral devices 
such as: optical disk media, audio adapters, and the like 
also may be utilized in addition to the hardware 
depicted. Data processing system 50 may include video 
storage devices (not shown) for storing digital data sets 
in either analog or digital formats. Examples of such 
video storage devices are laser disk players and video 
recording devices. Audio storage devices, such as com- 
pact disk players, also may be included in data process- 
ing system 50. 

[001 8] Figure 2 is a high level block diagram further 
illustrating details of a preferred data processing system 
50 as shown in Figure 1 . Data processing system 50 is 
controlled primarily by software executed within central 
processing unit (CPU) 202. CPU 202 is coupled to dis- 
play 204, and receives user input from user input device 
206. CPU 202 is also coupled to memory 208 and one 
or more direct access storage devices (DASDs) 
depicted at block 210. Memory 208 and DASD 210 may 
be used for storing data sets comprised of digital repre- 
sentations of text, graphics, sound, animated graphics, 
synthesized speech, and video. User input device 206 
may be a mouse, a touch sensitive tablet or screen, a 
joy stick, a track ball, or a screen activated light pen. 
CPU 202 also coupled to audio output device 212 and 
peripheral controller 214. Audio output device 212, 
which may include an amplifier and speaker system, 
may be utilized to present an audio portion of a multime- 
dia presentation. Peripheral controller 214 may be uti- 
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lized to control peripheral devices, such as a video 
player/recorder, a slide projector or a laser disk player, 
during a multimedia presentation. 
[0019] During a multimedia presentation, CPU 202 
may access data sets comprising digital representa- 
tions of text, graphics, animated graphics, and video, 
from memory 208 or DASD 210, and utilize display 204 
to display the visual portion of a multimedia presenta- 
tion. CPU 202 may also access data sets comprising 
digitized sound or data used to produce synthesized 
speech, and utilize audio output device 212 to present 
the aural portion of a multimedia presentation. 
[0020] Those persons skilled in the art will recog- 
nize that other media, besides aural and visual media, 
may be incorporated into a multimedia presentation. For 
example, the medium of motion may be utilized to com- 
municate the feeling of flight to the user of a flight simu- 
lator. A data set representing commands to move the 
flight simulator in a predetermined fashion may be 
accessed by CPU 202, in response to input from user 
input device 206, and then transmitted, via peripheral 
controller 21 4, to the mechanism which moves the flight 
simulator. 

[0021] Turning now to Figure 3, there is depicted 
display 204 at three sequential points in time during a 
multimedia presentation. Figure 3a illustrates first run- 
ning person 302 entering the field of view on display 
204. Although depicted in stick figure format within Fig- 
ure 3, those skilled in the art will appreciate that each 
person depicted therein may be presented as part of a 
video presentation. First running person 302 is an ani- 
mated element within the multimedia presentation. 
[0022] Figure 3b depicts two animated elements: 
first running person 302 leaving the field of view, and 
second running person 304 entering the field of view. 
Graphic indicator 306, which is associated with, and fol- 
lowing the motion of, second running person 304, may 
be utilized to indicate the presence of an associated 
data set stored within data processing system 50 which 
is also currently relevant to this portion of the multime- 
dia presentation. Such an associated data set may, in 
this example, contain additional information concerning 
second running person 304, and may be in the form of 
text, graphics, sounds, animated graphics, synthesized 
speech, or video. A data processing system user may 
choose to view or listen to the associated data set if the 
user requests the additional data set be presented, 
within a predetermined period of time during the multi- 
media presentation. The predetermined period of time 
in which a user may request to view an additional data 
set may be the period of time in which graphic indicator 
306 is displayed and associated with an animated ele- 
ment, such as second running person 304. 
[0023] Graphic button 310 may be utilized in con- 
junction with, or as an alternative to, graphic indicator 
306 to indicate the presence of a relevant associated 
data set. Graphic button 310 may also be utilized in con- 
junction with, or as an alternative to, graphic indicator 
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306 as a means to indicate the active portion of display 
204 wherein a user may elect to have a relevant associ- 
ated data set presented by selecting the active portion 
of display 204 utilizing a pointing device, such as a 
s mouse. 

[0024] Those persons skilled in the art will also rec- 
ognize that sound may be audibly variable or aurally ani- 
mated and therefore, music may be considered an 
animated element within a multimedia presentation. If 

10 the animated element having an associated data set is 
sound, the graphic indicator utilized to indicate the pres- 
ence of an associated data set may be an appropriate 
button, such as graphic button 310, graphically dis- 
played on display 204. 

is [0025] Figure 3c depicts a point in the multimedia 
presentation after the point illustrated in Figure 3b, 
where second running person 304 is leaving the field of 
view and no longer has graphic indicator 306 following 
second running person 304. Also shown entering dis- 

20 play 204 is third running person 308. Graphic indicator 
306 is displayed when a data set associated with an ani- 
mated element, such as second running person 304, 
exists and when the associated data set is relevant to 
what is transpiring in the multimedia presentation. 

25 [0026] Referring now to Figure 4, there is depicted 
a high level logical flow chart illustrating a programmed 
response of the data processing system of Figure 1 in 
accdrdance with a preferred embodiment of the method 
and system of the present invention during a set-up 

30 operation. Terminal block 400 represents the entry point 
to the process. First, as illustrated at block 402, data 
sets, which may include a multimedia presentation and 
the data to be associated with an animated element 
within the multimedia presentation, are created or iden- 

35 frfied within data processing system 50. Next, as illus- 
trated at block 404, the data sets are stored within data 
processing system 50. Block 406 illustrates the next 
step of associating the data sets with selected animated 
elements within a multimedia presentation. In this 

40 example, the multimedia presentation may be a video of 
people running in a foot race. The associated data set 
may be statistics, or an interview with, a particular run- 
ner in the race. 

[0027] Next, as depicted at block 408, a time period 
45 is selected in which a graphic indicator is displayed in 
association with selected animated elements to indicate 
the presence of an associated data set stored within 
data processing system 50. Typically, the graphic indi- 
cator is displayed when the associated data set is rele- 
so vant to the activity of the animated element at that 
particular time in the multimedia presentation. The 
graphic indicator may, for example, be a rectangle sur- 
rounding and following the animated element, as shown 
in Figure 3b by graphic indicator 306, or the graphic indi- 
55 cator may include a graphic button placed in display 
204. The graphic indicator may also be a blinking de- 
ment User selection of an additional data set may be 
accomplished by utilizing a graphic button in association 
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with a graphic indicator, such as graphic indicator 306. 
[0028] In addition to selecting a time to display a 
graphic indicator, as depicted at block 408, a period of 
time may be selected in which a user s attempt to select 
an associated data set is effective, as depicted at block s 
410. The period of time during the multimedia presenta- 
tion in which the associated graphic indicator is dis- 
played with an animated element is not necessarily the 
same period of time in which a user may select to view 
or listen to the associated data set. Finally, terminal 10 
block 412 represents the end of the set up process. 
[0029] With reference now to Figure 5, there is 
depicted a high level logical flow chart which illustrates 
a programmed response of the data processing system 
of Figure 1 in accordance with a preferred embodiment is 
f the method and system of the present invention during 
a graphic indication process. Terminal block 500 repre- 
sents the entry point to the process. First, as depicted at 
block 502, a multimedia presentation is started. A multi- 
media presentation may communicate data sets stored 20 
within data processing system 50 in several formats, 
including: text, graphics, sound (including hi-fidelity 
stereo), animated graphics, synthesized speech, and 
video. As the multimedia presentation continues, the 
process continuously determines whether or not an ele- 25 
ment having an associated data set is present within 
display 204, as illustrated at decision block 504. If ani- 
mated elements having associated data sets are not 
present, the process determines whether or not the 
multimedia presentation has been completed, as so 
depicted at decision block 506. If the multimedia pres- 
entation has been completed, the process ends, as 
illustrated terminal block 508. If the multimedia presen- 
tation has not been completed, the process continues 
presenting the multimedia presentation, as depicted at 35 
process block 510. 

[0030] Referring again to block 504, and after deter- 
mining that an animated element having an associated 
data set is present within the display, the process next 
determines whether or not the data set associated with 40 
the animated element is relevant at this particular point 
in the multimedia presentation, as illustrated at decision 
block 512. Selected animated elements will always be 
associated with particular data sets, but such data sets 
may not always be relevant to the present activity por- 45 
trayed in the multimedia presentation. If the associated 
data set is not relevant at this point in the multimedia 
presentation, the process continues to look for ani- 
mated elements within the display having associated 
data sets, as illustrated at decision block 504. so 
[0031 ] If the element having an associated data set 
is present within display 204 and the associated data 
set is currently relevant, the process illustrates graphi- 
cally that the animated element has a relevant associ- 
ated data set, as depicted at block 514. As discussed 55 
previously, the graphic indication may be a rectangle 
surrounding, and moving with, the selected animated 
element, as shown in Figure 3b by graphic indicator 



306. Next, the process permits the user to effectively 
select additional data sets associated with the selected 
animated element, as illustrated at process block 516. 
The process then determines whether or not the period 
for graphically indicating the existence of an associated 
data set has expired, as depicted at decision block 518. 
If such an indication period has not expired, then effec- 
tive user selection is permitted as illustrated at block 
516. If such an indication period has expired, then the 
process removes the graphic indication associated with 
the selected animated element, as illustrated at block 
520. The effective user selection period may or may not 
coincide with the period of time the graphic indication is 
associated with the selected animated element. There- 
fore, the process must separately determine whether or 
not the user selection period has expired, as depicted at 
decision block 522. If the user selection has not expired, 
effective user selection is permitted, as illustrated at 
block 524. 

[0032] If the user selection period has expired, then 
the process makes further attempts by the user to select 
the associated data set ineffective, as depicted at block 
526. After user selection has been made ineffective, as 
illustrated at block 526, the process determines whether 
or not the multimedia presentation has been completed, 
as depicted at decision block 506. If the multimedia 
presentation has not been completed, the process con- 
tinues presenting the multimedia presentation, as illus- 
trated at block 510, and the above process is repeated. 
If the multimedia presentation has been completed, the 
process ends, as illustrated at terminal block 508. 
[0033] Finally, with reference to Figure 6, there is 
depicted a programmed response of the data process- 
ing system 50 wherein the user selection of associated 
data sets is explained in further detail. Terminal block 
600 illustrates the starting point for the process. The 
process first determines whether or not a user has 
made an effective selection, as depicted at decision 
block 602. An effective user selection can only be made 
during a selected period of time as determined at proc- 
ess block 410 of Figure 4. If the user attempts to make 
a selection during any other period of time, the selection 
is considered ineffective and the process will continue 
waiting for an effective selection, as shown at decision 
block 602. 

[0034] If an effective user selection has been made, 
the multimedia presentation is paused, as illustrated at 
block 604. Then, a list of associated data sets is dis- 
played so the user may make a selection, as depicted at 
block 606. After displaying such a list, the process waits 
for the user to select an associated data set as illus- 
trated at decision blocks 608 and 610. If the user 
decides to cancel the selection of an associated data 
set, the process then determines whether the multime- 
dia presentation has been completed, as depicted at 
decision block 612. If the user has selected an associ- 
ated data set then the process presents the associated 
data set, as illustrated at block 614. Presentation of the 
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associated data set may be accomplished by opening a 
separate window on display 204 and presenting the 
associated data set which may comprise a variety of 
multimedia formats. After the associated data set is pre- 
sented, the process determines whether or not the mul- 5 
timedia presentation has been completed, as depicted 
at decision block 61 2. If the multimedia presentation has 
been completed, the process ends as illustrated at ter- 
minal block 614. If the multimedia presentation has not 
been completed, the multimedia presentation corttin- 10 
ues, as depicted at block 616, and the process waits for 
the next effective user selection, as illustrated at deci- 
sion block 602. If the user makes another effective 
selection, the process described above repeats. 

15 

Claims 

1. A method for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation stored in a data processing system, 20 
said data comprising at least one data set being 
stored within said data processing system, said 
method comprising the steps of: 

associating said at least one data set within 25 
said processing system with a selected ani- 
mated element within said multimedia presen- 
tation; 

providing a graphical indicator within said mul- 30 
timedia presentation indicative of the existence 
of said at least one data set and said associa- 
tion between said at least one data set and said 
selected animated element, whereby a user of 
said data processing system is informed of the 35 
existence of said at least one data set; 

permitting said user to select at least one data 
set for presentation; 

40 

retrieving and presenting said at least one data 
set in response to an input from said user indic- 
ative of the selection of said at least one data 
set; and 

45 

temporarily suspending said multimedia pres- 
entation in response to said retrieval and pres- 
entation of said at least one data set 

2. A method for selectively associating stored data so 
with animated elements depicted in a multimedia 
presentation according to claim 1 wherein said step 

of retrieving and presenting said at least one data 
set in response to an input from a user is permitted 
only during a selected period of time. ss 

3. A method for selectively associating stored data 
with animated elements depicted in a multimedia 



presentation according to claim 1 wherein said step 
of providing a graphical indicator within said multi- 
media presentation indicative of the existence of 
said at least one data set and said association 
between said at least one data set and said 
selected animated element comprises the step of 
temporarily displaying an additional graphical ele- 
ment in association with said selected animated 
element. 

4. A method for selectively associating stored data 
with an animated elements depicted in a multime- 
dia presentation according to claim 2 wherein said 
step of providing a graphical indicator within said 
multimedia presentation indicative of the existence 
of said at least one data set and said association 
between said at least one data set and said 
selected animated element comprises displaying 
an additional graphical element in association with 
said selected animated element only during said 
selected period of time. 

5. A method for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation according to claim 3 wherein said step 
of temporarily displaying an additional graphical 
element in association with said selected animated 
element comprises the step of displaying a rectan- 
gle which substantially surrounds said selected ani- 
mated element. 

6. A method for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation according to claim 1 wherein said step 
of associating said at least one data set within said 
data processing system with said selected ani- 
mated element includes the step of associating a 
plurality of data sets within said data processing 
system with said selected animated element, and 
further including the step of retrieving and present- 
ing a user with a choice of said plurality of associ- 
ated data sets in response to an input from a user. 

7. A system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation stored in a data processing system, 
said data comprising at least one data set being 
stored within said data processing system, com- 
prising: 

means for associating said at least one data 
set within said processing system with a 
selected animated element within said multi- 
media presentation; 

means for providing a graphical indicator within 
said multimedia presentation indicative of the 
existence of said at least one data set and said 
association between said at least one data set 
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and said selected animated element, whereby 
a user of said data processing system may be 
informed of the existence of said at least one 
data set; 

means for permitting said user to select said at s 
least one data set for presentation; 
means for retrieving and presenting said at 
feast one data set in response to an input from 
said user indicative of the selection of said at 
least one data set; and 10 
means for temporarily suspending said multi- 
media presentation in response to said 
retrieval and presentation of said at least one 
data set. 

15 

8. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to claim 7 wherein said means for retriev- 
ing and presenting said at least one data set in 20 
response to an input from a user permits retrieving 
and presenting said at least one data set in 
response to an input from a user only during a 
selected period of time. 

25 

9. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to claim 7 wherein said means for provid- 
ing a graphical indicator within said multimedia 30 
presentation indicative of the existence of said at 
least one data set and said association between 
said at least one data set and said selected ani- 
mated element comprises means for temporarily 
displaying an additional graphical element in asso- 35 
ciation with said selected animated element. 

10. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 40 
according to claim 8 wherein said means for provid- 
ing a graphical indicator within said multimedia 
presentation indicative of the existence of said at 
least one data set and said association between 
said at least one data set and said selected ani- as 
mated element comprises means for displaying an 
additional graphical element in association with 
said selected animated element only during said 
selected period of time. 

50 

11. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to claim 9 wherein said means for tempo- 
rarily displaying an additional graphical element in 55 
association with said selected animated element 
comprises means for displaying a rectangle which 
substantially surrounds said selected animated ele- 



ment. 

12. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to claim 7 wherein said means for asso- 
ciating said at least one data set within said data 
processing system with a selected animated ele- 
ment includes means for associating a plurality of 
data sets within said data processing system with a 
selected animated element, and further including 
means for retrieving and presenting a user with a 
choice of said plurality of associated data sets in 
response to an input from a user. 

PatentansprOche 

1- Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, abgebildet 
in einer Multimedia-Darstellung, die in einem 
Datenverarbeitungssystem gespeichert ist, wobei 
diese Daten mindestens einen Datensatz enthal- 
ten, der in dem Verarbeitungssystem gespeichert 
wird, und dieses Verfahren die fotgenden Schritte 
umfaBt: 

Zuordnen dieses mindestens einen Datensat- 
zes innerhalb des Verarbeitungssystems zu 
einem ausgewdhlten animierten Element 
innerhalb der Multimedia-Darstellung; 

Vorsehen eines graphischen Indikators inner- 
halb der Multimedia-Darstellung, der auf das 
Vorkommen dieses mindestens einen Daten- 
satzes und die Zuordnung zwischen dem min- 
destens einen Datensatz und dem gewdhlten 
animierten Element hinweist, wodurch ein 
Anwender des Datenverarbeitungssystems 
Ober das Vorkommen dieses mindestens einen 
Datensatz es unterrichtet wird ; 

Zulassen, daB dieser Anwender dies en minde- 
stens einen Datensatz zur Darstellung aus- 
w&hlt; 

Abrufen und Abbilden dieses mindestens einen 
Datensatzes als Reaktion auf eine Eingabe 
sertens des Anwenders, die auf die Wahl die- 
ses mindestens einen Datensatzes hinweist; 
und 

zertwetlig Unterbrechen dieser Multimedia-Dar- 
stellung als Reaktion auf das Abrufen und 
Abbilden dieses mindestens einen Datensat- 
zes. 

2. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, die in 



7 



13 



EP0 596 823 B1 



14 



einer Multimedia-Darstellung gemaB Anspruch 1 7. 
abgebitdet sind, wobei der Schritt des Abrufens und 
des Abbildens dieses mindestens einen Datensat- 
zes als Reaktion auf eine Eingabe seitens eines 
Anwenders nur wahrend einer ausgewahlten Zeit- 5 
sparine zuiassig ist. 

3. Ein Verlahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, die in 
einer Multimedia-Darstellung gemaB Anspruch 1 10 
abgebildet werden, wobei der Schritt des Vorse- 
hens eines graphischen Indikators in der Multime- 
dia-Darstellung, der auf das Vorkommen dieses 
mindestens einen Datensatzes und die Zuordnung 
zwischen dem mindestens einen Datensatz und 15 
dem gewahlten animierten Element hinweist, den 
Schritt des zeitweiligen Anzeigens eines zusatzli- 
chen graphischen Elements in Zuordnung zu dem 
gewahlten animierten Element beinhaltet. 

20 

4. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, die in 
einer Multimedia-Darstellung gemaB Anspruch 2 
abgebildet werden, wobei der Schritt des Vorse- 
hens eines graphischen Indikators in der Multime- 25 
dia-Darstellung, der auf das Vorkommen dieses 
mindestens einen Datensatzes und die Zuordnung 
dieses mindestens einen Datensatzes zu dem 
gewahlten animierten Element hinweist, die 
Anzeige eines zusatzlichen graphischen Elements 30 
in Zuordnung zu dem gewahlten animierten Ele- 
ment nur wahrend der gewahlten Zeitspanne 
beinhaltet. 

5. Ein Verfahren zum selektiven Zuordnen gespei- 35 
cherter Daten zu animierten Elementen, die in 
einer Multimedia-Darstellung gemaB Anspruch 3 
abgebildet werden, worin der Schritt des zeitweili- 
gen Anzeigens eines zusatzlichen graphischen 8. 
Elements in Zuordnung zu dem gewahlten animier- 40 
ten Elements den Schritt der Anzeige eines Recht- 

ecks beinhaltet, das im wesentlichen das gewahlte 
animierte Element umgibt. 

6. Ein Verfahren zum selektiven Zuordnen gespei- 45 
cherter Daten zu animierten Elementen, die in 
einer Multimedia-Darstellung gemaB Anspruch 1 
abgebildet werden, worin der Schritt des Zuord- 
nens dieses mindestens einen Datensatzes inner- 
halb des Datenverarbatungssystems zu dem so 
gewahlten animierten Element den Schritt des 9. 
Zuordnens einer Vielzahl von Datensatzen inner- 

halb des Datenverarbeitungssystems zu dem ani- 
mierten Element, und werter den Schritt des 
Abrufens und Stellens des Anwenders vor die Wahl 55 
eines aus der Vielzahl der zugeordneten Daten- 
satze als Reaktion auf eine Eingabe seitens eines 
Anwenders beinhaltet. 



Ein System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, abgebildet in 
einer Multimedia-Darstellung, die in einem Daten- 
verarbatungssystem gespeichert ist, wobei diese 
Daten mindestens einen Datensatz enthalten, der 
in dem Verarbeitungssystem gespeichert wird, errt- 
haltend: 

Mittel zum Zuordnen dieses mindestens einen 
Datensatzes innerhalb des Verarbertungssy- 
stems zu einem ausgewahlten animierten Ele- 
ment innerhalb der Multimedia-Darstellung; 

Mittel zum Vorsehen eines graphischen Indika- 
tors innerhalb der Multimedia-Darstellung, der 
auf das Vorkommen dieses mindestens einen 
Datensatzes und die Zuordnung zwischen dem 
mindestens einen Datensatz und dem gewahl- 
ten animierten Element hinweist, wodurch ein 
An wend er des Datenverarbeitungssystems 
uber das Vorkommen dieses mindestens einen 
Datensatzes unterrichtet werden kann; 

Mittel zum Zulassen, daB dieser Anwender die- 
sen mindestens einen Datensatz zur Darstel- 
lung auswahlt; 

Mittel zum Abrufen und Abbilden dieses minde- 
stens einen Datensatzes als Reaktion auf eine 
Eingabe seitens des Anwenders, die auf die 
Wahl dieses mindestens einen Datensatzes 
hinweist; und 

Mrttel zum zeitweiligen Unterbrechen dieser 
Multimedia-Darstellung als Reaktion auf das 
Abrufen und Abbilden dieses mindestens einen 
Datensatzes. 

Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung innerhalb eines Datenver- 
arbeitungssystems gemaB Anspruch 7 abgebildet 
sind, wobei das Mittel zum Abrufen und Abbilden 
dieses mindestens einen Datensatzes als Reaktion 
auf eine Eingabe seitens eines Anwenders das 
Abrufen und Abbilden dieses mindestens einen 
Datensatzes als Reaktion auf eine Eingabe eines 
Anwenders nur wahrend einer ausgewahlten Zeit- 
spanne zuiaBt. 

Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung gemaB Anspruch 7 abge- 
bildet werden, worin das Mittel zum Vorsehen eines 
graphischen Indikators in der Multimedia-Darstel- 
lung auf das Vorkommen dieses mindestens eines 
Datensatzes und die Zuordnung zwischen dem 
mindestens einen Datensatz und dem gewahlten 
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animierten Element hinweist, Mittel zum zeitweili- 
gen Anzeigen eines zusatzlichen graphischen Ele- 
ments in Zuordnung zu dem gewahlten animierten 
Element beinhaltet. 

5 

10. Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung in einem Datenverarbei- 
tungssystem gemaB Anspruch 8 abgebildet wer- 
den, worin die Mittel zum Vorsehen eines 10 
graphischen Indicators in der Multimedia-Darstel- 
lung, der auf das Vorkommen dieses mindestens 
einen Datensatzes und die Zuordnung dieses min- 
destens einen Datensatzes zu dem gewahlten ani- 
mierte Element hinweist, Mittel zur Anzeige eines is 
zusatzlichen graphischen Elements in Zuordnung 

zu dem gewahlten animierten Element nur w&hrend 
der gewahlten Zeitspanne umfaBt. 

11. Das System zum selektiven Zuordnen gespeicher- 20 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung innerhalb eines Datenver- 
arbeitungssystems gemaB Anspruch 9 abgebildet 
werden, worin das Mittel zur zeitweiligen Anzeige 
eines zusatzlichen graphischen Elements in Zuord- 25 
nung zu dem gewahlten animierten Element Mittel 

zur Anzeige eines Rechtecks beinhaltet, das im 
wesentlichen das gewahlte animierte Element 
umgibt. 

30 

12. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, die in 
einer Multimedia-Darstellung innerhalb eines 
Datenverarbeitungssystems gemaB Anspruch 7 
abgebildet werden, worin der Schritt des Zuord- 35 
nens dieses mindestens einen Datensatzes inner- 
halb des Datenverarbeitungssystems zu einem 
gewahlten animierten Element Mittel zum Zuord- 
nen einer Vielzahl von Datensatzen innerhalb des 
Datenverarbeitungssystems zu dem animierten 40 
Element, und weiter Mittel zum Abrufen und Stellen 
des Anwenders vor die Wahl eines aus der Vielzahl 
der zugeordneten Datensatze als Reaktion auf eihe 
Eingabe seitens eines Anwenders beinhaltet. 

45 

Revendications 

1 . Procede pour associer selectivement des donnees 
memorisees avec des elements animus represen- 
ts dans une presentation multimedia memorisee so 
dans un systeme de traitement de donnees, lesdi- 
tes donnees comprenant au moins un jeu de don- 
nees memorise a I'interieur dudit systeme de 
traitement de donnees, ledit procede comprenant 
les etapes consistant a : ss 

associer ledit au moins un jeu de donnees k 
I'interieur dudit systeme de traitement avec un 



element anime selectionne a I'interieur de 
ladite presentation multimedia ; 

procurer un indicateur graphique a I'interieur 
de ladite presentation multimedia indicatif de 
('existence dudit au moins un jeu de donnees et 
ladite association entre ledit au moins un jeu de 
donnees et ledit element anime selectionne, 
grace a quoi un utilisateur dudit systeme de 
traitement de donnees est inform6 de Pexis- 
tence dudit au moins un jeu de donnees ; 

permettre audit utilisateur de selectonner ledit 
au moins un jeu de donnees pour presentation 



retablir et presenter ledit au moins un jeu de 
donnees en reponse a une entree en prove- 
nance dudit utilisateur, indicatif de la selection 
dudit au moins un jeu de donnees ; et 

suspendre temporairement ladite presentation 
multimedia en response auxdits retablissement 
et presentation dudit au moins un jeu de don- 
nees. 

2. Procede pour associer selectivement les donnees 
memorisees avec des elements animes represen- 
ted dans une presentation multimedia selon la 
revendication 1 , dans leque) ladite etape de reta- 
blissement et de presentation dudit au moins un jeu 
de donnees en reponse a une entree en prove- 
nance d'un utilisateur est permise seulement pen- 
dant une periode de temps selectionne^. 

3. Procede pour associer selectivement des donnees 
memorisees avec des elements animes repr6sen- 
tes dans une presentation multimedia conform6- 
merit a la revendication 1, dans lequel ladite etape 
de fourniture d'un indicateur graphique a I'interieur 
de ladite presentation multimedia indicatif de I'exis- 
tence dudit au moins un jeu de donnees et ladite 
association entre ledit au moins un jeu de donnees 
et ledit element anime selectionne comprend 
I'etape consistant a aff icher temporairement un ele- 
ment graphique additionnel en association avec 
ledit element anime selectionne. 

4. Procede pour associer selectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia selon la 
revendication 2, dans lequel ladite etape de fourni- 
ture de I'indicateur graphique a I'interieur de ladite 
presentation multimedia indicatif de {'existence 
dudit au moins un jeu de donnees et ladite associa- 
tion entre ledit au moins un jeu de donnees et ledit 
element anime selectionne comprend I'affichage 
d'un element graphique additionnel en association 
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avec ledit element anime seiectionne seulement 
pendant ladite periode de temps selectionnee. 

5. Proc6d§ pour associer seiectivement des donn6es 
memorisees avec des elements animus repr6sen- s 
tes dans une presentation multimedia selon la 
revendication 3, dans lequel ladite etape d'affi- 
chage temporaire d'un element graphique addition- 
nel en association avec ledit element anime 
seiectionne comprend Petape d'affichage d'un rec- 10 
tangle qui entoure essentiellement ledit element 
anime seiectionne. 

6. Procede pour associer seiectivement des donnees 
memorisees avec des elements anim6s repr6sen- is 
t6s dans une presentation multimedia selon la 
revendication 1 , dans lequel ladite etape dissocia- 
tion dudit au moins un jeu de donnees a I'interieur 
dudit systeme de traitement de donnees avec ledit 
element anim6 seiectionne comprend I'etape 20 
dissociation d'une plurality de jeux de donn6es a 
I'interieur dudit systeme de traitement de donnees 
avec ledit element anime seiectionne, et compre- 
nant en outre retape de retablissement et de pre- 
sentation a un utilisateur avec un choix de ladite 25 
plurality de jeux de donnees associes en reponse a 
une entree en provenance d'un utilisateur. 

7. Systeme pour associer seiectivement des donnees 
memorisees avec des elements animus represen- 30 
tes dans une presentation multimedia memorisee 
dans un systeme de traitement de donnees, lesdi- 

tes donnees comprenant au moins un jeu de don- 
nees qui est memorise a I'interieur dudit systeme 
de traitement de donnees, comprenant : 35 

un moyen pour associer ledit au moins un jeu 
de donnees a I'interieur dudit systeme de trai- 
tement avec un element anime seiectionne a 
I'interieur de ladite presentation multimedia ; 40 

un moyen pour fournir un indicateur graphique 
a I'interieur de ladite presentation multimedia 
indicatif de ('existence dudit au moins un jeu de 
donnees et ladite association entre ledit au 45 
moins un jeu de donnees et ledit element 
anime seiectionne, d'ou il resutte qu'un utilisa- 
teur dudit systeme de traitement de donnees 
peut etre informe de I'existence dudit au moins 
un jeu de donnees ; so 

un moyen pour permettre audit utilisateur de 
seiectionner ledit au moins un jeu de donnees 
pour presentation ; 

55 

un moyen pour retablir et presenter ledit au 
moins un jeu de donnees en reponse a I'entree 
en provenance dudit utilisateur, indicative de la 



selection dudit au moins un jeu de donnees ; et 

un moyen pour suspendre temporairement 
ladite presentation multimedia en reponse 
auxdits retablissement et presentation dudit au 
moins un jeu de donnees. 

8. Systeme pour associer seiectivement des donnees 
memorisees avec des elements animes repr6sen- 
tes dans une presentation multimedia a I'interieur 
d'un systeme de traitement de donnees selon la 
revendication 7, dans lequel ledit moyen pour reta- 
blir et presenter ledit au moins un jeu de donnees 
en reponse a une entree provenant d'un utilisateur 
permet le retablissement et la presentation dudit au 
moins un jeu de donnees en reponse a une entree 
provenant d'un utilisateur seulement pendant une 
periode de temps s6lectionn6e. 

9. Systeme pour associer s£l ectivement des donnees 
memorisees avec les elements animes representes 
dans une presentation multimedia a I'interieur d'un 
systeme de traitement de donnees selon la revendi- 
cation 7, dans lequel ledit moyen pour fournir un 
indicateur graphique a I'interieur de ladite presenta- 
tion multimedia indicatif de I'existence dudit au 
moins un jeu de donnees et ladite association entre 
ledit au moins un jeu de donnees et ledit element 
anime seiectionne comprend un moyen pour affi- 
cher temporairement un element graphique addi- 
tionnel en association avec ledit element anime 
seiectionne. 

10. Systeme pour associer seiectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia a I'interieur 
d'un systeme de traitement de donnees selon la 
revendication 8, dans lequel ledit moyen pour pro- 
curer un indicateur graphique a I'interieur de ladite 
presentation multimedia indicatif de ('existence 
dudit au moins un jeu de donnees et ladite associa- 
tion entre ledit au moins un jeu de donnees et ledit 
element anime seiectionne comprend le moyen 
pour afficher un element graphique additionnel en 
association avec ledit element anime seiectionne 
pendant ladite periode de temps selectionnee. 

1 1 . Systeme pour associer seiectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia a I'interieur 
d'un systeme de traitement de donnees selon la 
revendication 9. dans lequel ledit moyen pour affi- 
cher temporairement un element graphique addi- 
tionnel en association avec ledit element anime 
seiectionne comprend un moyen pour afficher le 
rectangle qui entoure essentiellement ledit element 
anime seiectionne. 
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1 2. Systeme pour associer s6lectivement des donneas 
memorises avec des 6l6ments animgs represen- 
ts dans une presentation multimedia a I'interieur 
d'un systeme de traitement de donnees selon la 
revendication 7, dans lequel ledit moyen pour asso- 5 
cier (edit au moins un jeu de donnees a I'interieur 
dudit systeme de traitement de donnees avec un 
element anim6 seiectionne comprend un moyen 
pour associer une plurality de jeux de donn6es a 
I'interieur dudit systeme de traitement de donnees w 
avec un 6l6ment anime" selectionn6, et qui com- 
prend en outre un moyen pour retablir et presenter 
a I'utilisateur un choix de tadite plurality de jeux de 
donnees associes en reponse a une entree en pro- 
venance de I'utilisateur. 75 
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